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Abstract 

The aim of the study is to determine the status of Turkey among OECD (Organisation for Economic 
Co-operation and Development) members and candidate countries through cluster and discrimi¬ 
nant analyses according to PISA (Programme for International Student Assessment) 2009 results. 
The study includes 475460 fifteen year-old students from 65 countries participating in the PISA 
Project in 2009. According to the cluster analyses , in the first cluster, 13 countries, 9 of which are 
candidate countries; in the second cluster 30 countries, 5 of which are candidate countries; in the 
third cluster 10 countries, 5 of which are candidate countries and in the fourth cluster 12 countri¬ 
es, all of which are candidate countries were clustered. Turkey was clustered in the first cluster 
and along with Turkey, Bulgaria, Chile, Colombia, Israel, Jordan, Mexico, Dubai (UAE), Romania, 
Serbia, Thailand, Trinidad, and Tobago were clustered in the first cluster, too. According to the 
discriminant analyses, 96,9% of original grouped cases correctly classified. 
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In todays world, in which the notion of global¬ 
ization is predominant on areas such as educa¬ 
tion, economy, military, and technology, many 
organizations have been established such as Eu¬ 
ropean Union (EU), Organisation for Economic 
Co-operation and Development (OECD), United 
Nations (UN), North Atlantic Treaty Organiza¬ 
tion (NATO), International Monetary Fund (IMF), 
etc. It is seen that these organizations, which were 
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established in different times, share common pur¬ 
poses. For instance, EU and OECD have a com¬ 
mon characteristic which is “economic develop¬ 
ment”. Whereas Turkey is one of the founders of 
OECD, she is still an EU candidate. It is possible 
to encounter many national and international dec¬ 
larations, reports, and academic studies in which 
Turkey in the EU accession process is compared to 
EU countries in terms of socio-economic param¬ 
eters (Ada Altun, 2011; Erkekoglu, 2007; §ahin 
& Hamarat, 2002; Yilmaz & Kaya, 2005). In these 
studies, development indicators of countries are 
examined and compared frequently. Whereas the 
level of education in which variables such as the 
rate of literacy, schooling, the schooling of girls 
are discussed with priority in some studies, oth¬ 
ers regard macro-economic variables such as gross 
national product, rate of inflation, real growth, 
purchasing power, etc to be the indicators of devel¬ 
opment. United Nations Development program, by 
using Human Development index as an indicator 
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of development, presented a common notion to re¬ 
searchers (Erkekoglu). With Human Development 
index, countries are categorized as high, medium, 
and low human development depending on three 
variables that are income, education and health 
(Morse, 2003). 

Mankiw et al. (1992) use the ratio of the population 
at the age of 15-19 enrolled in secondary education 
to the active population as an indicator of human 
development (as cited in Dura, Atik, & Turker, 
2004). To what extent the population at the age of 
15-19 uses knowledge in various areas, the level of 
access to knowledge, reasoning, problem-solving 
etc. skills are important for the countries in this 
regard. In this context, PISA (Programme for In¬ 
ternational Student Assessment) project, whereby 
the skills of 15-years-old students in science, math¬ 
ematics, and reading are assessed in OECD coun¬ 
tries, prove an important source of information 
regarding the determination of the shortcomings 
in national education systems and for their devel¬ 
opment. 

With the PISA project, it is aimed to determine 
not only to what extent 15-years-old students who 
are at the end of the compulsory education process 
remember what they have learned but also their 
ability to apply what they have learned to their lives 
outside the school, to what extent they are able to 
utilize their knowledge and skills in order to un¬ 
derstand new situations they would encounter, 
to solve problems, to make estimations on issues 
which they do not have sufficient knowledge and 
their utilization of reasoning (Education Research 
and Development Department/Egitim Ara§tirma 
Geli§tirme Dairesi [EARGED], 2011b). In PISA ex¬ 
ams, along with Science, Mathematics, and Read¬ 
ing Competency areas, student and school surveys 
are also applied in order to collect information 
about some other indicators which are considered 
to be related to student performance (social, cul¬ 
tural, economic, and educational indicators) (Or¬ 
ganisation for Economic Co-operation and Devel¬ 
opment [OECD], 2009). 

Turkey participated in the project, which is being 
applied in three-year periods, in 2003 for the first 
time. The latest exam was held in 2009. The statuses 
of countries participant in PISA in terms of mem¬ 
bership and candidacy to OECD are given. 

It is seen that in 2009, PISA project was applied 
to totally 65 countries, 31 of which are OECD 
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members. Among 65 participant countries, Tur¬ 
key ranked 43 rd in 2 nd level in terms of the level of 
learning in Science and Mathematics, and 41 st in 
2 nd level in terms of the level of Reading Competen¬ 
cy (Ozen<; & Arslanhan, 2010). According to these 
findings, it can be argued that Turkey’s rank is not 
a desired one. According to PISA-2009 results, Fin¬ 
land ranked 1 st in terms of Reading Competency 
and Science whereas Hong Kong-China ranked 1 st 
in Mathematics (Ozen<; & Arslanhan). 

Purpose 

Today, the subject of the majority of the research 
conducted on PISA results consists of the short¬ 
comings observed in the system of education, 
comparison of Turkey to other countries in terms 
of the level of success, and the reasons for both 
successes and failures (Anil, 2009; Aydin, Erdag, 
& Ta§; 2011; Berberoglu & Kalender, 2005; Qelen, 
Qelik, & Seferoglu, 2011; (^obanoglu & Kasapoglu, 
2010; Guzel i§, 2006; Ozen<; & Arslanhan, 2010; 
Savran, 2004). This study, however, investigates the 
position of Turkey among OECD members and 
candidate countries according to PISA 2009 results 
through clustering and discriminant analyzes. It 
also aims at determining the common variables in 
the classification of countries that stand together 
with Turkey. 

Method 

Universe and Sampling 

This study is a descriptive research which deter¬ 
mines Turkeys position among OECD members 
and candidate countries. The universe of research 
consists of totally 475.460 15-years-old students 
from 65 countries that participated in PISA proj¬ 
ect in 2009. In other words, sampling did not take 
place since the study included all the units within 
the universe. 

Instrument 

No data collection instruments were used for this 
research. However, certain measurement instru¬ 
ments including various question types such as 
multiple-choice, mixed multiple-choice, open- 
ended, and closed are employed in PISA project. 
With these measurement instruments, data on 
subject areas such as Mathematical literacy, Sci- 
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ence literacy, Reading Skills as well as student mo¬ 
tivation, students’ views about themselves, their 
ways of learning, school atmosphere, and about 
their families are collected (EARGED, 2011b). It 
is stated in PISA 2009 National Memorandum that 
great efforts were made in order to ensure the va¬ 
lidity and reliability of measurement instruments 
for all countries and to minimize cultural and 
linguistic differences and thus findings obtained 
through PISA have the highest validity and reli¬ 
ability (EARGED, 2011a). 

Process 

Data of the research were obtained from PISA- 
2009 PISA’s official webpage. Variables used in the 
research are Mathematics, Science, and Reading 
Competency scores. The first one of those scores 
which were estimated in five was processed. Firstly, 
the average of Mathematics, Science, and Reading 
Competency scores of totally 475.460 students par¬ 
ticipated in PISA 2009 from 65 countries were cal¬ 
culated according to countries. In this way, Math¬ 
ematics, Science, and Reading Competency scores 
of each country were obtained. Average Mathemat¬ 
ics, Science and Reading Competency scores of 
countries were used during the operations of clus¬ 
tering and discriminant analyzes. 

Firstly the clustering analysis was applied to the 
data. Clustering Analysis is the collection of meth¬ 
ods that help the categorization of those units, 
variables, or units and variables in X data matrix, 
the natural classification of which is unknown, 
into sub-sets (groups, classes) similar to each other 
(Tathdil, 1992). That is, the clustering analysis is 
the method of categorizing units, variables, or units 
and variables within a data stack about the struc¬ 
tures of which there is no certain information into 
sub-sets (classes, groups) (Ozdamar, 2002). 

Clustering analysis was performed over the sets 
via the method of non-hierarchic K-means. The 
analysis assumed 2 and 3 sets; however, it was seen 
that distance values did not present a normal dis¬ 
tribution. The results of Kolmogrov-Smirnov Test 
conducted to determine whether the distance val¬ 
ues present a normal distribution when the analy¬ 
sis was carried out with 4 sets are indicated in this 
research. 

The assumption of the normality of variables in 
multi-variable statistical analyses is not very im¬ 


portant in clustering analysis and the normality 
of distance values seems adequate (Tathdil, 1992, 
p. 252). Therefore, when the set number is deter¬ 
mined as 4, it is seen that distance values present a 
normal distribution (p> 0.05). 

At the second step, discriminant analysis was per¬ 
formed over the same data. Discriminant Analysis 
is a method that allows the categorization of vari¬ 
ables within X data set into two or more real groups 
and generates functions that enable the assignment 
of units to their proper real groups and classes 
most suitably by treating p amount of characteris¬ 
tics of such units (Ozdamar, 2002). 

In the clustering analysis, the result of Box’s M-test 
was evaluated for the assumption of homogeneity 
in the discriminant analysis of the average Math¬ 
ematics and Science test scores and is indicated. 

Following Box’s M test, it was seen that the assump¬ 
tion of the non-homogeneity of covariance matri¬ 
ces was satisfied (p>0.05). 

Findings 

Findings of Clustering Analysis 

The distribution of 65 countries which are cat¬ 
egorized under 4 sets according to the estimated 
Reading Competency, Mathematics, and Science 
scores obtained from PISA 2009 is indicated in this 
research. 

According to the findings, the 1 st class consisted of 
13 countries 9 of which were OECD candidates, 
the 2 nd class consisted of 30 countries 5 which 
were OECD candidates, the 3 rd class consisted of 
10 countries 5 of which were OECD candidates 
and the 4 th class consisted of 12 all of which were 
OECD candidates. Turkey was categorized under 
the 1 st class in which Bulgaria, Chile, Columbia, 
Dubai, Israel, Jordan, Mexico, Romania, Serbia, 
Thailand, Trinidad & Tobago, and Uruguay were 
included. The results of the investigation concern¬ 
ing whether the variables of Reading Competency, 
Mathematics, and Science scores were important in 
the determination of classes are presented. 

According to ANOVA results, it is observed that 
Reading Competency, Mathematics, and Science 
variables are significant in the formation of the 
classes (p< 0.05). 
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Findings of Discriminant Analysis 

Wilks’ Lambda and Chi-Square test statistics re¬ 
garding its success on assigning countries to the 
groups, and whether the discriminant function is 
meaningful are presented. 

According to the results, it is seen on the Table that 
the success of the discriminant function regarding 
the assignment of countries to the groups is sig¬ 
nificant for the first two functions (p<0.05). Stan¬ 
dardized coefficients belonging to the discriminant 
function are given in this research. 

The Table 7 shows that three functions are generat¬ 
ed and the canonic correlation of the first function 
is 0,962. It can be said that the 1 st function is highly 
effective in categorizing countries into groups. The 
results of the investigation concerning whether 
the average scores of Mathematics, Science, and 
Reading Competency variables differ among four 
groups are presented. 

In the clustering analysis, it was seen that Read¬ 
ing Competency, Mathematics, and Science vari¬ 
ables were determinant in the categorization of 65 
countries that participated in PISA 2009 assess¬ 
ment into four sets (p<0.05). The fact that Wilks’ 
Lambda values approximates to zero implies that 
these variables are highly effective in terms of cat¬ 
egorization (Qokluk, §ekercioglu, & Biiyukoztiirk, 
2010). Wilks’ Lambda values of Reading Compe¬ 
tency, Mathematics, and Science variables were 
also observed to be close to zero. The results of 
discriminant analysis regarding the correctness of 
categorization are presented in this research. 

It was observed that 2 of the countries which com¬ 
pose the 2 nd class did not belong to this class but 
were estimated in 1 st and 3 rd classes. Generally, 
when Science, Reading Competency and Math¬ 
ematics PISA-2009 test scores pertaining to the 
countries that are categorized into four classes are 
considered, it is seen that discriminant analysis 
performed a correct categorization with a rate of 
96.9%. The findings regarding the average scores 
and standard deviations pertaining to the perfor¬ 
mance of countries which belong to the categorized 
classes in PISA-2009 Mathematics, Reading Com¬ 
petency and Science tests are given. 

It was observed that thirteen countries within the 
1 st class, to which Turkey also belonged, obtained 
an average score of 425.66 from 2009-PISA Math¬ 
ematics test, 434.69 from Science test, and 437.04 
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from Reading Competency test. However, Turkey 
was observed to have higher average scores than 
those of other countries which shared the same 
class (Mathematics 446.91, Reading Competency 
466.42, and Science 455.45). 

When the average scores obtained by countries 
within various classes from 2009-PISA Mathemat¬ 
ics, Reading Competency, and Science tests are ob¬ 
served, it is seen that the most successful class was 
the 3 rd whereas the least successful was the 4 th . The 
countries within the 1 st class, to which Turkey be¬ 
longed, ranked third in terms of the average scores 
obtained from Mathematics, Reading Competency, 
and Science tests. In other words, their averages in 
terms of test success are observed to be low. 

Discussion 

It is noticeable that the 3 rd class, which is the most 
successful one in terms of results obtained from 
PISA-2009 Mathematics, Reading Competency, 
and Science tests, contained those countries 
such as Finland, Hong Kong-China, South Ko¬ 
rea, and Japan. The common characteristic of the 
countries within this class is their completion of 
curriculum modifications in line with the prin¬ 
ciples of a knowledge-based economy (Kalkan, 
2008). Besides, these countries are observed to 
have equality of opportunity, competent instruc¬ 
tors, guidance for students according to their 
skills in their systems of education, a social cul¬ 
ture and understanding that values literacy, etc 
(Qobanoglu & Kasapoglu, 2010). Apparently, 
the quality of the system of education of a given 
country is directly proportional to economic in¬ 
dicators. Turanli and Deniz (2008) suggested that 
the differences observed during the classification 
of 34 countries including Turkey were generally 
due to the population and to the ratio of the bud¬ 
get allocated to education from GDP. Therefore, 
Turkey should catch up EU average in terms of 
economic indicators in order to display success in 
international projects such as PISA and TIMSS. 
Yilmaz and Kaya (2005) found out that Turkey 
and Romania belong to the same class in terms of 
those indicators such as inflation rate, the ratio of 
budget balance to gross domestic product, the ra¬ 
tio of total public debt to gross domestic product, 
long-term interest rate and gross domestic prod¬ 
uct per capita. This study also observed Turkey 
and Romania to belong to the same class. Stud- 
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ies in which economic indicators are discussed 
are also evaluated along with the categorization 
study based on 2009-PISA results; and it is also 
observed in other studies that Turkey is grouped 
together with other countries belonging to the 
same class in this study Erkekoglu (2007), in her 
study, put forth that Turkey fell under the same 
class with Lithuania, Latvia, Poland, Bulgaria, 
and Romania as a result of a clustering analysis 
applied to 28 countries in terms of 39 variables 
such as demographic, educational, health, infor¬ 
mational, communicational as well as economic 
indicators. According to the PISA-2009 results, 
both in this study and Erkekoglu s study, Bulgaria 
and Turkey belong to the same class. Tathdil and 
Cinel (1997), in their study conducted on 12 vari¬ 
ables such as life expectations, the rate of literacy 
among adults, GDP, population growth rate, na¬ 
tality per woman, the rate of infant mortality, in¬ 
flation rate, the share of agriculture within GDP, 
and the share of exports within domestic produc¬ 
tion, found out that Turkey belongs to the same 
class with Bulgaria, Czech Republic, Hungaria, 
Malta, Poland, and Romania. When PISA-2009 
results are compared to the study of Tathdil and 
Cinel that Turkey belongs to the same class with 
Bulgaria and Romania is common. 

Recommendation 

It is possible to investigate those educational indi¬ 
cators determinant in the formation of classes and 
the common characteristics of the systems of edu¬ 
cation of the countries belonging to same groups 
after the classification conducted via clustering 
and discriminant analyses within the scope of this 
study. Along with that, it is possible to compare 
and contrast the future conditions of the countries 
within the class to which Turkey belongs and other 
countries as well as an evaluation at national level 
by using national and international educational 
indicators and the outcomes of techniques such as 
clustering and discriminant analyses. 
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